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This study investigated the use of feedback and 
encouragenent in iiproving counselor effectiveness. Clients judged 
their counselors significantly higher than did expert raters. 
However, a significant correlation occured between the client and 
rater opinions concerning helpful counselors. Counselors receiving 
feedback based on client-*rat6r evaluations and also obtaining 
encourageaent to plan and iipleaent alternative behaviors improved 
significantly tore on their pre-post total scores thflin did a Matched 
control group of counselors. All counselors iaproved their 
client-rater scores as a result of a supervised practicu* experience. 
iKplications and suggestions for counselor supervisors are included. 
(Author) 
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niPROVING COUNSELOR EFFECT IVETIESS BY 
MEANS OF FEEDBACK AND EtICOURGEIffiKT 

Defining and raaasurtef; the characteristics of effective 
counaelors is an ongoing task for counseling psychologitts* The 
Graduate Record Exaninntion and other neasures of acadenic ability 
such as grade point nverapeo appear to be of little value in pre- 
dictinf? counselor success. In fact, several studies (Carkhuff and 
Bcrenson, 1967; Carkhuff » 1969; Berenson, Carkhuff, and Myrus, 1966; 
and Carkhuff and Truas, 1965) have shoxm that the counselors who 
are functioning at the highest levels of understanding nay receive 
the lox^est grades in their trainlnj? programs. In seekinn nore valid 
criteria, oaay rating? scales have been eiaployed, but such Instrunenta 
have been criticised due to problems Includina the halo effect, rater 
leniency, and rater bias. 

The relevance of client satisfaction ratings has also been 
debated by couaaalora. Romero (1951) stressed that clients alone 
have the potential of knowing fully thier perceptions and behavior. 
Jorgensen and Jurat (1972) found a hlp.h decree of conrxuence between 
counselor and client perceptions of both their own and each others 
capcbtllty. Conversely, professional criticism of client ratlnrs 
Include a tendency toward subjectivity and bias (Pohlmn, 1964; 
Patterson, 1956; an<i Pj:>3en, 1967). McAlvalne (1972) reported 
favorable rfasults in uffHy.infT. c^wictiod nli 

sources of uvaluntinj* cnunsalors* However^ Whitely (1967) warns 



that the results obtainet! fron coachuvi clients do not advance know- 
lad{2e of what actlous a counselor nay talco to help their clients, 

llany stuiitss have denonstrate:! the usefulness of feedback in 
tnprovinn counselor effectiveness, Basic learning theories dcvelope^t 
by Skinner (1938) indicate that behavior nay be nodified or shaped by 
reinforcing appropriate !;ahavior. In or<ler that an association be 
oade between the desirable behavior and the reinf orcenent , Skinner 
stressed Icjnediacy in obtaininjj 'naxinun effect. Carlson (1974) found 
that Imediata verbal feclback significantly increased the qualitative 
levels of enpathic verbal porfomance of counsel '>r trainees. Verbal 
conditioning studios (Greenspoon, 1355; Krasner 1958, Dorr*, and Blocher, 
1974) and the use of such equipnent as liphta an! nodified hearing aida 
(Goff, 1963; Redly, 1569) have yielded nixeil results in elJninatinf: 
the tine differential between couaselinf; behavior and supervision feed- 
back. Jacobs (1974), at, al,, have also shown that ancnynous feedback 
increases the cre^.lMlity and desirability of positive and negative 
structured feedback. 

Ruble (1974) has identified at least four distinct types of 
tcedbacks (a) Inforoal verbal and (b) infernal ^^ritten feedback, 
plus (c) foroal verbal and (d) fornal ^wlttan feedback. Informal verbal 
feedback utilizes general discussions of counseling situations using 
the trainee as a nof!el, with an atterant to tie counseling behavior to 
client responses by including behavlc>r?l alternatives. Types of 
lafomal written fced!^ack Include weekly lor^s of counscr' inf» experiences 
that are shared with the supervisor as well as written critiques of 
taped interviews, Foroal wltten feedback occurs when individual 
ratinB scales are used trilth specific behavior or attitude character- 
istics !>ein<^ cnployed. Finally, formal verbal feedback consists of 
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couti&ual» conaiatent feudback, inclullnn tha ro:!ollttf* of effective 
CQuasaXias sUlIls* AXthourr^ stu.!iea cited provloualy have investlp^ted 
Instant, onjjoing fecJback durlor^ the actual couoaellpn aoasions by 
aeans o£ lights, aorphosea, etc*, the present study Includas & caof 
!;ioatlon of infoimX and fonual written aaj varl-sl fee^^back ahar^f! 
with tralnaea one to five tlaya aftar ?sacb ccun^f ,lin<! aeasion* Because 
the study waa conducted during an oafsolasr counacU n?* practicun» tSt** 
control f»foup receivof'. in*omrl v6rt?il anA written feftl^ack. The 
exporincntnl Rrou^) Im-^ the a??1ttionaX benefit of fornaX witten and 
verbal feedback. 

Other studies have shown that Indlvlduftla nay ehanr;<» their behavior 
through perceived inccnaiateacies between self anJ others* Bertz 
says that people strive to achieve coftRruence botr^een the* way they 
desire to be perceived and the actual perceptions others hold of then. 
Conbs, et, al,, (1971) stress the nsed for counselors to observe the 
consequences of their acts. Thus, this stuiy evaluated the use of 
feedback and encouracfioent in iioprovlns counsel c*r effectiveness by 
testiuit for sifjnificlant aean differences between the following CJn- 
trasting c^^ups: 

1» Counselors reccivia<; or not recelvlnp formZ. fee !back. 

2, Ratinns by professional counselor educators or by the 
clients themselves •.?p;rrdinp thsii* irapre&uions of tVa 
sane counselor trainees. 

3* Pre and post-ten*: rank-crdev tctal scores of courtrrolors 
receivinj^ or net receivlnc; fomal feedback, 

ttetho d 

The study was conf Inoit to twenty-four pradupte students enrolled 
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in four Initial counsQlinf» practicun courses at the University of 
South Carolina. Twelve of the counsoXors were mle and twelve were 
fenale; one was black. The practicuu experience lasted fifteen (15) 
weeks, with counselor trainees receivinr: a variety of practicun 
experiences in direct supervision vith university clients and indirect 
supervision in nore than twenty school and comunity a<>oncioa (i.e. 
juvenile /incl adult corrections^ oental health, etn^loyaont service, 
etc,). 

Weekly neetlnrs of five practicun students with the instructor 
and an advanced doctoral student (two hoctrs) were supi^leneuted by 
weekly individual scsslors with each trainee (one-two hours)* Case 
notes, sunnary reports, an.' a weekly counselinr; lof» were mintained 
for all clients, xdith each trainee accunulatinj* a nininum c>f 30-35 
client contact hours durinr the senester. Audio tapes of all counselin?* 
sessions wer*i secured, including at least one video-taped session in 
the Guidance Center, All trainees were p.iven the opportunity to view 
nodelinr of specific counselinp. skills by supervisors, 

Eiaht advanced doctoral candidates and doctoral graduates in 
counselor education serve! as the raters of counselor effectiveness, 
Sip.ht tape ! sa;*nents frnn counsel int; sessions were judged independently 
by each rater with a Pearson product-^<^nent correlation indicatinc; 
the inter-rater reliability to ranre fron .68 to ,91, All of these 
correlations were sinnificant beyond the ,001 level. 

The clients cjnsioteU of adolescents and adults requestinj? 
counsclinp; services fron the University Guidance Center, Prior to 
their initial saesion with the counselor trainees, the author con- 



tacted all cllonta, seekinf thair cooperation In 6vnlu?^tinp the 
ccunaalors, Asouriaf;^ the clients that their ratings would be kept 
confidential, plus answering, any questions concerning the rating 
scale itself* Such a brief or lent <)t ion wns aimeet at receiving tiore 
honest responses rather than coachin<^ or trainin;; the clients in any 
canner* The counselor trainees were unaware that they xwre belQp 
rate'! by the clients. 

No attenpt was novie at controlling the age, race, or sgk of the 
clients requesting counselinp, services, or at standardizinp, the total 
nunbar of counselinf* aessiond in the fci^*ht vock" interval. Thirty- 
elRht clients attended a total of 108 counselinft sessions. Of the 
total client population, 58% were white fenalea with a nean a(^e of 
. 21; 32% wore white mlee with a taean age of 22; 5% were Mark tiaIcr, 
averane af»e 24; and 5% were black femles, averasc a<Te 22, 

Instrc aents 

The Perceptual Characteristics Scale consists of twelve bl-polar 
variables which previous research (Conbs ancl Soper, 1963, Coribs etc, 
al#, 1969) has sho^TO discriminates sinnificaatly between successful 
and unsuccessful counaalors. The twelve bi-polar variables include 
the following arcasj A« General perceptual orientation, incluJinr.: 
!• internal-external fr.tne of reference, and 2, people-things; B, 
Perceptions of other pec pic, including: 3, able-una!>lc, 4, dependablc- 
undepen^^able, 5. friendl, '-unfriendly, and 6, worthy rather than un- 
worthy; C, Perceptions of self, includin.n;! 7* \riLth people-apart ft on 
people, 8, enoufjh-wantinr* 9, self-revealinr-self-concealinjt; and 
D, Overall purposes, inclvdinp: 50, freeinff-controllinff, 11, altruism- 
narcisslsn and 12, larper u>ianin^s-8ctaller ceaninns. An overall total 
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score base H on the sxua of the twelve vnria' Ics was also o^tained. 

The author cleveli-jpeit ounselor Evaluation Sijini3ary,ena')llnf 
clients to rate their counselors by trans forninfi: each variable into 
n declarative sentence. For example, the "people-thinfs" variable 
consisted, of: *'My counselor xs more concerned with people and their 
reactions than with thing's or events*" Clients rated the counselors 
on a nine-point scale ran^infr from "always" (9,0) to "never" (1*0)» 

Procedure 

The initial session btecwoen each client an.-? counselor was taped 
an'l later judpet! Minc^ly t-.y the raters, T<-» rci'.uce the chance of one 
] particular sennent biasing the raters* scores, five different three- 

ninute intervals from the counselinp. session were recorded on a separate 
tape for the raters, A nean score based cn the five separate ratinps 
for all variat'les was obtained, the total score serving as the overall 
neasurc of the trainee's pro-test counselin<% effectiveness. 

The total nean scares wore used in placing all twenty-four 
counselors in rank order pouitions fron hiphest to lowest sun scores. 
Three e;roups of aip,ht trainees each were otrtaine'l and laheled hiph, 
nediun, or low rated counselors respectively. 

Based on the hir.h-nediun-lnw n^^'^upinns, fr>ur counselor trainees 
fron each affect were then selected randomly f;or either an experinental 
or a control ^roup. Counselors in the exijerincntal rti^oup received 
written feedback concerning rater and client perceptions at tine inter- 
vals of two, five, and ei^ht weeks. 



ERIC 



8 



In a brief forn accwpatiyinr tha chart, counselors receiving fomal 
fee^hack and Qncou*af»cncsnt waro also askad tn specify: (a) the behaviors 
that went into fominfx such a "perceptual Inap.cj" (b) the specific 
types of behavior they wtntc*! to chanpOj (c) the perceptual toapes they 
desired to improve; and (d) alternative behaviors in attcnptincx to 
nodify or improve their own perceptual teape to others. Such reactions 
to the ratings coupled wit i specific Ijehavinral alternatives were dis- 
cussed with the author and the practicun supervisor. 

The pre-tost interview and the concluding p.>at-te8t intorvlew w«ia 
judged by the raters, while continuous client ratinf^s inncdiately 
after each counselins session were also obtained throuchout the ciaht- 
week interval. Thus, experinental counselors received their pre-test 
evaluations !y the raters, plus nean scores fron all cl.'ent:: they had 
seen during each tl-ie interval. The control rtou? did not receive any 
client or rater feedback. 

After eij^ht weeks, all counselors complete'! a post-test consisting 
of an initial interview with a new client. The raters judp.ed blindly 
three pre- and three post-teat counsolinp tapes. Because the clients 
and raters were evaluatinp; the sane counselors, it rras also possible 
to compare their scores. 

Statistical Analysis 

The independent fixed affects ware (a) counselor trainee ratinps 
(high, oadiuti, low); (b) rater and client feedback of counselor 
effectiveness (received, not received); and (c) three tine intervals 
for racer and client feedback (two, five, and oipht weeks), Thfe 
dependent variables were: (a) rater nean pre and post-test scores 
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based on the Percoptual Characteristics Scale an.! {!,) client moan pre 
and post-test scares ol^talnet! frora the Counselor Evaluacl.'sn Sumary. 

A 2 X 2 X It analysis ot variance tested Sot significant differences 
?iatween levels of throe cnntraste^ variables (pro-post, experlncntal- 
control» and the hir;h-nedlun-low rated levels of counselor effective- 
ness) • A chi-squara was conputed for the rank ordor finish by ^oth 
the exparioental and control jwoups* 

Results 

Although an analysis of variance was calculated for each variable, 
only the key ftndinjs and relevant total ncan scores based on a tsaxinun 
of 108 total points will be prooente !, Th© resttlts nwy be wtnimrlze'd 
in the following mnner: 

1» Independent client ratings of all trainees judpod by pro- 
fessional counselor educators as hi^h, nedlun, or low In pre- 
practicun effectiveness were significantly (p4(.01) slnllar 
(x* 82, 78, and 69 respectively) • 
2* Professional ritlnfra for all counselors inproved sisnificantly 
(P*C»05) durlnf? the pro-post eicht week training Interval 
(x: 74 & 79 respectively), 

3, Clients judged the same trainees significantly .(p<<, 0001) 
higher than did professional counselor educators (tcs 87 & 66 
respectively) , 

4. Although clients had greater ncan ratings, there was a high 
correlation between the client-rater opinions of success- 
ful counselors* A Pearson product-oonent correlation 
conparlng client and rater aean sccres rms slnnif leant 
above the #01 lcv»l (*■«• ,78) # Thus, both ntoups appeared 
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adept at dlfferontlatlnn vetious 1«voIr of rrttmoaX^ 
efCectlvoriQas. 

5. Both the exvarlmntal mid control p.roups increased on all 
client and rater variables reaultlnp. ttnu a supervisor! 
practlcuo experience. Such chanRas by all trainees arpear 

to Indicate self- ^-.plorat ion, insip.ht* nnA !-,*»hnviorfll fthan«oe 
due to tralnittB and feedback froa clients ani supcrvlaora, 

6. The axpcriaental group rcccivlnf? ft^mal fecf^.Uck and encourare- 
ment had htp.her total post-test mean scores (78 & 75 respec- 
tively). A chl-square tased on the pre-post rank-or'-^r scprus 
indicated that the experimental p.rc'UP Improved sl<;nif icantly 
(P<.05) nore than did the oatched control-Rroup counselors* 
Seven of the highest eight post-test scores by the total 
trainee t^roup wore earned by counselors recelvlnp fomal feed- 
back and encouragement. 

Inplicatlotts 

A oajor finding of the study was that a significant correlation 
occurred !)etwacn clients and raters in their perceptions of helpful 
counselors. In the current era of accountability, the innrcsslons of 
both clients and raters should be utlUaed in assessing counselor 
effectiveness. Supervisors also have an ethical responsibility of 
encouraging counselors consistently receiving low client and rater 
evaluations to nodlfy their counseling behavior, or, as a lant resort, 
to pursue other vocational opportunities. 

But feedback will be nost effective If each trainee has the option 
of decidlnc t*hether or not the client and raters opinions are valid. 
Such a supervisory attitude csn help prevent the defensive trainee 

o _ 1 i 
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reactions of denial, projection, or rationalization concorninp 
evaluati:>na. Supervisors should finf*. that labaXinp specific counsaling 
behaviors as "effective or ineffective*' rather than "Roof*. cr bad" 
often encourages trainees to be more receptive to client-rater feedback, 

/mother findinyt was that the overall client opinions were riuch 
higher than siaHar rater scores* One possible explanation for such 
ratings nay be that noat clients indicated they had fome.! negative 
isaagas baaed largely on peer opinions of their high school guidance 
counselors. Most clients asstmed that such counselors were sel4cn 
involved with personal concerns of students* Thus, the clients were 
pleasantly surprised when the graduate counselor trainees display'3<! 
p»>ttu4no underotand4n{», lending to client insif^hts an^l behaviornl 
changes* The counselors also helped modify a common belief that "only 
abnorml people seek counselinn services*" Ly changing previous 
negative attitudes of raany clients toward the entire counselinr, process, 
nost trainees earned high client ratinns. 

The raters probably usai a different stan'lard in judf»inft covuiselors 
than did the clients* ^-Jhcreas clients often had no actual counseling 
experiences, the raters quite pos8i!-ly cnnparei'. the sane counselors 
to such an eninent helping person as Carl Rop.ers* Thus, laost trainees 
probably exceeded client expectations basel on limited exposiire to 
hinh school counselors. Conversely, few trainees net rater standards 
judped by constant conparisons with profassicaal therapists. 

Since all feedback was based on a nomal standard distribution, 
it can be state! "objectively" that thu total ftroup of trainees received 
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oqual percent anos of "positive" and "nsrjatlva" feedback. However, 
the subjective "inner ftane of rafcrance" of each trainee nade such 
feedback difficult to quantify objectively. For example, one 
counselor receiving hish scores was disappointed because his scores 
Wire not the hif»haat. Individual value jud^ents concerninr^ the 
relative Inportance of the twelve different variables also influenced 
personal reactions to hirh or low scores. 

Anothor najor finiinq was that fonaal feed!>ack coupled with 
encourap^enent can aid counselors. Festln?er*s (1957) theory f^f 
cocnitive dissonance states that individuals strive to mintain 
hamony between internal and external evaluations. Festinrcr 
postulates that when a person holds "nonfittin::" ccmiitlons about 
self, Individual behavior, and the cnvironoent, such inconsistent 
"lissonant" fcelinps td.ll be Inportant. When individuals becoiae 
aware that they are actln? in a fashion discrepant with an inportant 
attitude, either the attitude or the behavior will channc. In 
this study, positive fecc»back and encouragement probably reinforced 
counselors who believed they were effective helpers. For counselors 
having a low self concept, positive feedback regardinp their coun- 
selins behavior could have stlnulated an encoura<»in<; chanp,e in their 

oxm self-perceptions. 

Conversely, negative feedback nay al'< both cnmpeteuu and hesitant 
counselors in rc-evaluatinp their own level of helpfulness. Such nega- 
tive feedback initially raay result in discouranenent, but such discre- 
pancies nay serve as a needed catalyst for counselors in taodifying 
their attitudes or behaviors. Over-confident counselors receiving low 
ratings oay decide they are not destined to be effective counselors 
after all (an attitude channe) ; or they taay improve their actual 
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counseling skills (a t^ehavlot change)* In feithcr events such "nofrft- 
tive" feedback can lead to a "positive" nodif Icatlon In attitudes 
and/or behaviors. 

For exanple, one counselor receiving low pre-test ratings salds 
"Initially, I was afraid to counsel individuals for fear of ruininp 
their life. But the nore I thought about the ratin^,s» the more I 
reaiizQd I needed to x^ork on sone thinc^.s* 1 nade a plan, followed it, 
end now I feel bettor ahout nyself and ny counsellnr skills,'* 

Thus, !)cth "positive" and "nei^atlve" fee.iback can lead to chancres 
in attitudes and T-ehaviors when couple?^ rdlth supervisor encourapenent 
toward iQproving specific counseling behavinrs. 
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